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Abstract 

We consider two well-known natural variants of bin packing, and show that these packing problems 
admit asymptotic fully polynomial time approximation schemes (AFPTAS). In bin packing problems, 
a set of one-dimensional items of size at most 1 is to be assigned (packed) to subsets of sum at most 
1 (bins). It has been known for a while that the most basic problem admits an AFPTAS. In this paper, 
we develop methods that allow to extend this result to other variants of bin packing. Specifically, the 
problems which we study in this paper, for which we design asymptotic fully polynomial time approxi- 
mation schemes, are the following. The first problem is Bin packing with cardinality constraints, where 
a parameter k is given, such that a bin may contain up to k items. The goal is to minimize the number of 
bins used. The second problem is Bin packing with rejection, where every item has a rejection penalty 
associated with it. An item needs to be either packed to a bin or rejected, and the goal is to minimize the 
number of used bins plus the total rejection penalty of unpacked items. This resolves the complexity of 
two important variants of the bin packing problem. Our approximation schemes use a novel method for 
packing the small items. Specifically, we introduce the new notion of windows. A window is a space in 
which small items can be packed, and is based on the space left by large items in each configuration. The 
key point here is that the linear program does not assign small items into specific windows (located in 
specific bins), but only to types of windows. This new method is the core of the improved running times 
of our schemes over the running times of the previous results, which are only asymptotic polynomial 
time approximation schemes (APTAS). 

1 Introduction 

Classic bin packing ll27l [TTl |6l |3 is a natural and well studied problem which has applications in problems 
of computer storage, bandwidth allocation, stock cutting, transportation and many other important fields. In 
the basic variant of this problem, we are given n items of size in (0, 1] which need to be assigned to unit 
sized bins. Each bin may contain items of total size at most 1, and the goal is to minimize the number of bins 
used. Many variants of bin packing, coming from practical needs, were studied llT0l l9l. Below, we mention 
several such variants that we address in this paper. 

In various applications, such as storage of files on disks and scheduling of jobs on bounded capacity 
processors, a bin can contain only a limited number of items. This is the main motivation for the study 
of the following variant of the bin packing problem. The BIN PACKING PROBLEM WITH CARDINALITY 
CONSTRAINTS (BPCC) is defined as follows: The input consists of an integer k >1 (called the cardinality 
bound) and a set of n items / = {1, 2, . . . , n}, of sizes 1 > si > S2 > • • • > Sn > 0. The goal is to partition 
the items into the minimum number of bins such that the total size of items in a bin is at most 1 , and the 
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number of items in a bin is at most k. The problem was introduced as early as in the 1970's by Krause, Shen 
and Schwetman |[23ll24l . and studied in a sequence of papers Bll22l|2l [T5]l . 

In other applications, such as bandwidth allocation, or any application in storage that allows outsourcing, 
it is sometimes possible to refuse to pack an item. This rejection clearly needs to be compensated, and costs 
some given amount for each item. This amount is called the rejection penalty of the item. This situation 
can also occur in file servers where the items are files, the bins are disks and rejection penalty of a file is the 
cost of transferring it to be saved on an alternative media. In other applications the rejection penalty refers 
to the penalty caused by not serving a client. This motivates the following BIN PACKING PROBLEM WITH 
REJECTION (BPR). The input to this problem consists of n items / = {1,2,..., n}, where item i has a 
size Si G (0, 1] and rejection penalty rj > 0, and the goal is to select a subset Aoi I (the set of accepted 
items, i.e., items to be packed) and a partition of A into subsets Ai, . . . , A^, for some integer z, such that 
Yl -Sj < 1 for all j = 1, 2, . . . , z, so that z+ ^ is minimized. The bin packing problem with rejection 

ieAj ieI\A 

was introduced and studied by He and Dosa fT3l. Further work on this problem can be found in fT4', '3l|. 
Note that in this problem we assume without loss of generality that all sizes of items are strictly positive. If 
zero sized items exist, they could be all packed into one bin, changing the cost of the solution by 1 in the 
case that all other items are rejected by this solution and without any change in the cost otherwise. 

Note that both problems studied in the paper are generalizations of classic bin packing. Classic bin packing 
is the special case of BPCC where k = n, and the special case of BPR where all rejection penalties are 
infinite. 

For an algorithm A, we denote its cost by A as well. The cost of an optimal offline algorithm is denoted 
by OPT. We define the asymptotic approximation ratio of an algorithm A is the infimum TZ > I such that 
for any input, A < TZ ■ OPT + c, where c is independent of the input. If we enforce c = 0, 7^ is called 
the absolute approximation ratio. An asymptotic polynomial time approximation scheme is a family of 
approximation algorithms, such that for every e > the family contains a polynomial time algorithm with an 
asymptotic approximation ratio of 1 + e. We abbreviate asymptotic polynomial time approximation scheme 
by APTAS (also called an asymptotic PTAS). An asymptotic fully polynomial time approximation scheme 
(AFPTAS) is an APTAS whose time complexity is polynomial not only in the input size but also in If 
the scheme satisfies the definition above with c = 0, stronger results are obtained, namely, polynomial time 
approximation schemes and a fully polynomial approximation schemes, which are abbreviated as PTAS and 
FPTAS. Throughout the paper, we use OPT to denote the cost of an optimal solution for the original input, 
which is denoted by /, and we use APX to denote the cost of the solution returned by our schemes. For an 
input J we use OPT (J) to denote the cost of an optimal solution for the input J (where J is typically an 
adapted input). Thus OPT = OPt(/). 

Previous results. The classic bin packing problem is known to admit an APTAS |[T2l and an AFPTAS 
121,1. Moreover, BPCC and BPR are problems that are known to admit an APTAS EHI^I. Specifically, 
the APTAS of Caprara, Kellerer and Pferschy lH generalizes the methods of Fernandez de la Vega and 
Lueker |[T2l where items are rounded and grouped using linear grouping. The approach, that is used to 
deal with items that are too small to be rounded in this way, is not a greedy approach as in (TT\ (which 
fails in this case, as is demonstrated in [4J), but all possible packings of large items are enumerated, and 
for each such possibility, the small items are assigned to the already existing bins and to new bins via a 
linear program. This last approach, that is used also in |[T4ll . where it is combined with rounding of rejection 
penalties, results in an APTAS for each one of the problems BPCC and BPR. Clearly, these schemes have 
large running times due to enumeration. A different APTAS for BPR, with reduced running time, but that 
still uses some enumeration steps, is given in liSJ. Note that classic bin packing or any generahzation of it 



2 



cannot be expected to admit an FPTAS or even a PTAS, since approximating it within an absolute factor 
smaller than | is NP-hard (using a simple reduction from the PARTITION problem). 

A problem which is dual to bin packing is the bin covering problem. In this problem the goal is to 
maximize the number of bins for which the total sizes of assigned items is at least 1 . This problem is known 
to admit an APTAS (by Csirik, Johnson and Kenyon and an AFPTAS (by Jansen and Solis-Oba |[l9l ). 
The variant of this problem where a covered bin must in addition to the constraint on the total size of items 
assigned to it, must contain at least k items, for a parameter k, we get the problem of bin covering with 
cardinality constraints. This last problem was considered in lfT6l . and was shown to admit an AFPTAS as 
well. We note that even though bin packing problems are the dual problems of bin covering, the latter are 
maximization problems while the former are minimization problems, and the nature of the problems is very 
different. In particular, the methods of [16] as well as the methods of HI [HI are not applicable for the 
problems considered in this paper, and hence we needed to develop the new methods considered here. 

We briefly survey the previous approaches used in the literature for dealing with packing small items 
fractionally using a linear program. One approach is to see all small items as fluid, without distinguishing 
between different items. In this case, the small items completely lose their identities, and the conversion 
process of the fluid into items is performed in a later step, usually greedily. The other approach which allows 
to keep the identities of items simply allows to introduce constraints associated with each small item sepa- 
rately, and the solution of the mathematical program assigns each small item into a specific bin. The number 
of constraints is linear in the number of items. It can be seen that in the first approach there is no control 
whatsoever of the exact allocation of specific items to specific bins, while the second approach is rigid in 
the sense that all decisions must be made by the mathematical program. Examples for the first approach can 
be found as early as in the seminal work of Hochbaum and Shmoys ifTSl on scheduling uniformly related 
machines, in approximation schemes for other scheduling problems (e.g. flj), and in previous work on bin 
packing related problems Iil9i, iSJ. Examples of the second approach appear in the previous work on the 
problems studied here B1 [T4| . 

In this paper, we use a new and novel method of dealing with small items which is an intermediate way 
between these two extreme (previous) approaches. These items are packed using the (approximated) solution 
of a linear program. To keep the running time polynomial (in both the size of the input and e), the linear 
program does not decide on the exact packing of these items, but only on the type of a bin that they should 
join, where a type of a bin is defined roughly according to the remaining size in it after the packing of 
(rounded) large items, and in BPCC, on the cardinality constraint as well. 

In this paper, we design an AFPTAS for each of the two problems, BPCC and BPR. Studies of similar 
flavor was widely conducted for other variants of bin packing and it is an established direction of research, 
see e.g. |[20ll25ll26l . The problems studied in this paper were open in the sense that no AFPTAS is known 
for them prior to this work. 

We start the paper with Section [2l where we elaborate on the methods used in this paper. In Sections [3] 
and|B]we describe the asymptotic approximation schemes for BPCC and BPR, respectively, and prove their 
correctness. The approximation scheme for BPCC acts in two different ways according to the value of k. 
The case of small k is easier, since in this case every bin has a relatively small number of items. This simpler 
scheme is presented first, and it allows the reader to get acquainted with the basic methods (but not with our 
new methods for dealing with small items). The other schemes presented in this paper, including the scheme 
for BPCC with large values of k, and the scheme for BPR, require much more advanced techniques. The 
methods that are employed, in order to obtain these two schemes, are related, but each scheme requires 
different specific ingredients, developed in this work, in order to solve the problem it is meant for. Due to 
space limitations, we present the easier case of Section[3l and the AFPTAS for BPR in the Appendix. 
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Note that asymptotic fully polynomial approximation schemes, unlike APTAS results, have practical run- 
ning times especially if one uses a method of solving approximately the linear program which is faster than 
the ellipsoid method. Such techniques are available for packing problems. Hence, AFPTAS can actually be 
used to solve the problems they are developed for. Thus our contribution, where we settle the complexity of 
the problems studied here, is interesting not only from a theoretical point of view, but also from the practical 
viewpoint. 

2 Methods 

In this section we briefly describe the novel methods that are used in this paper, side by side with adaptations 
of well known methods, that are employed in this paper as well. 

Linear grouping is a standard rounding method for bin packing algorithms. It was first presented by 
Fernandez de la Vega and Lueker [12|. The main idea of this method is to round the sizes of items into a 
small number of distinct sizes. Unlike rounding methods for scheduling [TTI . the output sizes resulting from 
the rounding must be representative sizes of real item sizes in the input. In fact, this last method of rounding, 
which rounds values from a given range (in our case, rejection penalties) to a closest number among a fixed 
sized set of values, such that no original value changes as a result by more than a factor of 1 + e, is used in 
the paper as well in Section |B] Both methods are typically used for sizes that are large enough, where small 
sizes are treated separately. The resulting set of large items has a small number of sizes (usually, a function 
of e). On this set of sizes, valid assignment configurations are defined, and a solution to a packing problem 
is described as a set of bins packed according to specific configurations. 

In this paper, we introduce a new and novel method for treatment of small items. These are typically items 
whose size is below some threshold. Moreover, in Section |B] items of small rejection penalty are seen as 
small as well. For the classic bin packing problem, the treatment of such items is relatively easy. After 
finding a solution, which is close enough to optimal solution for the large items, small items can be added 
greedily to the solution, using a simple packing heuristic such as Next Fit or First Fit. As demonstrated 
by Caprara, Kellerer and Pferschy O, using this approach for BPCC leads to approximation algorithms 
of high approximation ratio. That is, finding an optimal packing of just the large items immediately leads 
to poor performance for the complete input, no matter how the small items are combined into the solution. 
In order to derive an APTAS, i.e., an algorithm whose approximation ratio is within a factor of 1 + e, but 
its running time is not necessarily polynomial in i, it is possible to enumerate a large enough number of 
packings of the large items, and add the small items to each one of them in some way (possibly in an optimal 
fractional way). This results in a large number of potential outputs, the best of which is actually given as the 
output. On the other hand, if the goal is to design an AFPTAS, where the running time must be polynomial 
in i, this approach cannot be successful. First, the number of packings of large items is exponential in i, 
and second, if small items need to be added optimally and not greedily, it is unclear whether it is possible 
to handle small items efficiently since in their case, rounding of sizes is harmful. In summary, in order to 
obtain an AFPTAS, we need a method which allows to consider the small items in the linear program that 
seeks a solution for the large items, but this linear program cannot search for a complete and final solution 
for all items. We introduce the new notion of windows. A window is a space in which small items can be 
packed, and is based on the space left by large items in each configuration. The key point here is that the 
linear program does not assign small items into specific windows (located in specific bins), but to types of 
windows. Using rounding, we limit ourselves to a polynomial number of window types. After the linear 
program has been solved, the small items are assigned to specific windows based on the output. We show 
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that the items that cannot be assigned to windows (due to fractional solutions, due to rounding, or due to the 
fact that the windows reside in separate bins) can be packed separately into new bins (or possibly rejected, 
in BPR) with only a small increase in the cost. In order to allow the packing of almost all small items, in 
most cases studied here, their packing cannot just be done greedily given the windows reserved for them. A 
careful treatment that balances the load of small items in similarly packed bins, taking into account not only 
the total size of small items, but also their number, is required. 

In order to find an AFPTAS and not an APTAS for each one of the problems, the linear program, that is 
associated with the problem on an adapted input (after rounding is applied, and our methods for handling 
small items are invoked), cannot be solved exactly in polynomial time (in n and -). Therefore, we need 
to solve it approximately. This is done via the column generation technique of Karmarkar and Karp f2T]. 
The main idea is to find an approximate solution of the dual linear program. For that, we need to find a 
polynomial time separation oracle (possibly, an approximate one) for each one of the dual programs. This 
typically involves finding an approximate solution to a knapsack type problem. The exact problem results 
from the exact characteristics of the bin packing problem and the details of the linear program used to solve 
it. We develop the linear programs as well as the separation oracles for them in this paper. Clearly, each 
problem results in a different linear program, a different dual linear program, and a different separation 
oracle. These separation oracles are based on application of fully polynomial approximation schemes to 
variants of the knapsack problem. 

3 An AFPTAS for BPCC 

We fix a small value £ < such that ^ is an integer. Our AFPTAS acts according to one of two options, 
each of which is suitable for one case. In the first case k < X and in the second case k > X. Recall that 
the set of items is denoted by /. We refer to an item by its index, so / = {1, 2, . . . , n}. The first case can be 
found in the Appendix. 

3.1 Second case: k > ^ 

We assume that k < n, otherwise there is no effective cardinality constraint, and an AFPTAS for the problem 
follows from the AFPTAS of Karmarkar and Karp 121]. In this case we partition the item set into large items, 
that is, items with size at least e, and small items (all the non-large items). We denote by L the set of large 
items, and by 5 = I \ L the set of small items. We apply linear grouping to the large items (only). That 
is, we partition the large items into classes Li, L2, . . . , -^^i/^s such that = \Li \ > IL2I > • • • > 

l^i/e^ I = Ll-^k^J' ^i^^ &Vich that if there are two items i,j with sizes Si > Sj and i £ Lq and j € Lp then 
q < p. The two conditions uniquely define the allocation of large items into classes up to the allocation of 
equal-sized items. If |L| < p-, then instead of the above partition, each large item has its own set Li such 
that Li is an empty set, and for a large item j we let s'j = Sj (i.e., we do not apply rounding in this case). 
We note that in both cases (where we use the original partition of the items or when \L\ < ^) we have 
|Lil<2e3|L|. 

Then, we round up the sizes of the items in L2, . . . , Li/^a as follows: For all values of p = 2, 3, . . . , 
and for each item i e Lp, we let s'^ = maxjg sj to be the rounded-up size of item i. For a small item i £ S 
we let s[ = Si. The rounded-up instance /' consists of the set of items I \ Li where the size of item i is 
for all i (k remains unchanged). We also define L' = L \ Li to be the set of large items in the rounded-up 
instance. We have OPt(/') < OPT. 
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Given the rounded-up instance we define a configuration of large items of a bin as a (possibly empty) 
set of at most k items of L' whose total (rounded-up) size is at most 1. We denote the set of all configurations 
of large items by C. We denote the set of item sizes in L' by H. For each v G H we denote the number of 
items with size t; in C by n{v, C), and the number of items in L' with size v by n{v) (where n{v) = WL\e^\ 
or n{v) = [|L|£^], unless several classes are rounded to the same size). 

We denote the minimum non-zero size of an item by Sjnin = "^^^ieS-.s'-^o ^'v 

s'min = ™ax{ ^ \t e Z, _^^y < Smin} ■ 

We have s'^^^ < Smin and s'^in > ^f+f and thus the value logi^^ -7^ is polynomial in the size of the input. 

min 

We define the following set W = \t , a)\0 <t < log^^^ -r^ — h 1, < a < A;}. A window is defined 
as a member of W. W is also called the set of aU possible windows. Then, \W\ < n ■ (logi_,_£ -r^^ — h 2), 

min 

since the number of possible values of the second component of a window is /c + 1 < n. For two windows, 
and tip' where w"^ = {wl,Wn) for i = 1,2, we say that uP < uP if wj^ < and w], < Wg. 
Note that a bin, which is packed with large items according to some configuration C, typically leaves 
space for small items. For a configuration C, we denote the main window of C hy w{C) = {wg {C),Wn{C)) 
(where Wg (C) is interpreted as an approximated available size for small items in a bin with configuration 
C, and Wn (C) is interpreted as the number of small items that can be packed in a bin with configuration 
C while still maintaining the cardinality constraint). More precisely, a main window is defined as follows. 
Assume that the total (rounded-up) size of the items in C is s'(C). Let Ws{C) = jf^^ where t is the 
maximum integer such that < t < logj^ , ^ -7^^ h 1 and that s'{C) + jtt^ > 1, and Wn{C) is the 

min V . / 

difference between k and the number of large items in C (i.e., Wn{C) = k— '^(^j C*)). Note that in any 

case, for a non-trivial input, t can take at least three values. The main window of a configuration is a window 
(i.e., belongs to W), but W may include windows that are not the main window of any configuration. We 

note that |yV| is polynomial in the input size and in i, whereas \C\ may be exponential in ^ (specifically, 
\C\ < (p- + l)^^*^, since in configuration there are up to ^ large items of \H\ < ^ sizes). We denote the 
set of windows that are actual main windows of at least one configuration by W'. We first define a linear 
program that allows the usage of any window in W. After we obtain a solution to this Unear program, we 
modify it so that it only uses windows of W'. 

We define a generalized configuration C as a pair C = {C, w = {wg, Wn)), for some configuration C and 
some w ^W. A generalized configuration C is a valid generalized configuration if w < w{C). The set of 
all valid generaUzed configurations is denoted by C. 

For W ^ W denote by C{W) the set of generalized configurations C = {C,w = {ws,Wn)), such that 
w = W. That is, C{W) = {C = {C,w) € C : W = w}. 

We next consider the following linear program. In this linear program we have a variable x^j denoting 
the number of bins with generalized configuration C, and variables Yi^w indicating if the small item i is 
packed in a window of type W (the exact instance of this window is not specified in the solution of the 
Unear program). 
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Constraints ([T|l and Q ensure that each item (large or small) of /' will be considered. The large items will be 
packed by the solution, and the small items would be assigned to some type of window (but not to a specific 
location). Constraints ^ ensure that the total size of the small items that we decide to pack in window of 
type W is not larger than the total available size in all the bins that are packed according to a generalized 
configuration, whose second component is a window of type W. Similarly, the family of constraints dH) 
ensures that the total number of the small items that we decide to pack in a window of type W is not larger 
than the total number of small items that can be packed (in accord with the cardinality constraint) in all the 
bins whose generalized configuration of large items induces a window of type W. The linear relaxation 
assumes, in particular, that small items can be assigned fractionally to windows, that is, the small items 
leave no gaps. We later show how to construct a valid allocation of small items, leaving a small enough 
number of small items, whose total size is small enough as well, unpacked. We further show how to deal 
with these unpacked items. We note that OPt(/') implies a feasible solution to the above linear program that 
has the cost OPt(/'), since the packing of the small items clearly satisfies the constraints Q and (HJl, and 
the packing of large items satisfies the constraints ([T]). Moreover, it implies a solution to the linear program 
in which all variables x^, that correspond to generalized configurations C = (C, w) for which w is not the 
main window of C, are equal to zero, and all variables Yi „, where w ^ W are equal to zero as well. 

We invoke the column generation technique of Karmarkar and Karp ||2T| as follows. The above linear 
program has an exponential number of variables and a polynomial number of constraints (neglecting the 
non-negativity constraints). Instead of solving the linear program we solve its dual program (that has a 
polynomial number of variables and an exponential number of constraints). The variables correspond to 
the item sizes in H. The variables Pi correspond to the small items. The intuitive meaning of the variables 
can be seen as weights assigned to these items. For each G W we have a pair of dual variables 7^^/ and 
5w- Using these dual variables, the dual linear program is as follows. 
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max Yl n{v)av + J2 Pi 

S.t. Yln{v,C)ay+WsJw+WnSw<'^ WC = {C,W = {Ws,Wn)) & C (5) 

Pi - s'aw - <5iy < Vi G 5, VPT G W (6) 

a^, > MveH 
Pi>0 Vi G 5 

First note that there is a polynomial number of constraints of type (O, and therefore we clearly have a 
polynomial time separation oracle for these constraints. If we would like to solve the above dual linear 
program (exactly) then using the ellipsoid method we need to establish the existence of a polynomial time 
separation oracle for the constraints However, we are willing to settle on an approximated solution to 
this dual program. To be able to apply the ellipsoid algorithm, in order to solve the above dual problem 
within a factor of 1 + e, it suffices to show that there exists a polynomial time algorithm (polynomial in n, 
- and log -7^) such that for a given solution a* = {a* , (]* ,-f* ,S*) decides whether a* is a feasible dual 

solution (approximately). That is, it either provides a generalized configuration (7 = {C,w = {ws,Wn)) G C 
for which Yl "^(^i C')a* + Wsj^ + ^n^^ > 1, or outputs that an approximate infeasibility evidence does 

not exist, that is, for all generalized configurations C = {C,w = {ws, Wn)) G C, ^ n{v, C)a* + Wsj^ + 

Wn^lj < 1 + e holds. In such a case, is a feasible dual solution that can be used. Such a configuration C 
can be found by the following procedure: For each W = {ws,Wn) G W we look for a configuration C £ C 
such that (C, W) is a valid generalized configuration, and Yl ^(^j C')a* is maximized. If a configuration 

C that is indeed found, the generalized configuration, whose constraint is checked, is (C, W). To find C, 
we invoke an FPTAS for the KCC problem with the following input: The set of items is H where for each 
V £ H there is a volume a* and a size v, the goal is to pack a multiset of the items, so that the total volume is 
maximized, under the following conditions. The multiset should consist of at most k — Wn items (taking the 
multiplicity into account, but an item can appear at most a given number of times). The total (rounded-up) 
size of the multiset should be smaller than 1 — -t^, unless Ws < s'-„, where the total size should be at most 

-\~S I I til i 

1 (in this case, the window leaves space only for items of size zero). Since the number of applications of the 
FPTAS for the KCC problem is polynomial (i.e., this algorithm runs in polynomial time. If it finds a 
solution, that is, a configuration C, with total volume greater than 1 — tfs7^ — Wn^^, we argue that (C, W) 
is indeed a valid generalized configuration, and this implies that there exists a generalized configuration, 
whose dual constraint ^ is violated. By the definition of windows, the property Wg < s'^in is equivalent to 

s' 

Ws = -fj^, which is the smallest size of window (and the smallest sized window forms a valid generalized 
configuration with any configuration, provided that the value of Wn is small enough). Since C has at most 
k — Wn items, the main window of C in this case is no smaller than {ws,Wn) and therefore, the generalized 
configuration (C, W) is valid. If Wg > s^m' recall that the main window of C, {ws{C),Wn{C)) is chosen 
so that s'{C) + WsiC) > 1, and that C is chosen by the algorithm for KCC so that s'{C) < 1 - j^. We 
get 1 — Ws{C) < s'{C) < 1 — and therefore Wg < {1 + s)ws{C), i.e., Ws < Ws{C) (since the sizes of 
windows are integer powers of 1 + e). Since C contains at most k — Wn items, we have Wn{C) > Wn and so 
we conclude that W < {ws{C),Wn{C)), and (C, W) is a valid generalized configuration. Thus in this case 
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we found that this solution is a configuration whose constraint in the dual linear program is not satisfied, 
and we can continue with the application of the ellipsoid algorithm. 

Otherwise, for any window W = {ws,Wn) and any configuration C of total rounded-up size less than 
1 — (or at most 1, if Wg < s'^in)' with at most k — Wn items, the total volume is at most (1 + e)(l — 
Wg^^ — WnS^) < (1 + e) — Ws^^ — WnS^- We prove that in this case, all the constraints of the dual hnear 
program are satisfied by the solution Consider a valid generalized configuration C = (C, {ws,Wn))- 
We have {ws,Wn) < (tL's(C), ii;n(C)), where (?i;s(C), t(;„(C)) is the main window of C. lfws{C) < s^j„, 
then Ws = Ws{C). Since s'{C) < 1 for any configuration, and Wn < Wn{C), where k—Wn{C) is the number 
of items in C, C is a possible configuration to be used with the window (wsjWn) in the application of the 
FPTAS for KCC. Assume next that Wg < 1, then when the FPTAS for KCC is apphed onW = (ws^Wn), 
C is a configuration that is taken into account for W since s'{C) < 1 — ^[^J < 1 — j^, where the first 
inequality holds by definition of Ws{C), and C has at most k — Wn{C) < k — Wn items. \f Wg = 1 then 
1 > Ws{C) > ?is = 1> so Ws{C) = 1. A configuration Ci that contains at least one large item satisfies 
s\Ci) > e, so s'(Ci) + > "^^^^ > 1. Therefore if the main window of a configuration is of size 
1, this configuration is empty. We therefore have that C is an empty configuration, thus s'{C) = and 
Wn < Wn{C) = k. This empty configuration C is considered with any possible window. 

We denote by {x* , Y* ) the solution to the primal linear program that we obtained. Since its cost is a ( 1 + e) 
approximation for the optimal solution to the hnear program, we conclude that ^ x*^ < {1 + e)OPT(/'). 

We modify the solution to the primal linear program, into a different feasible solution of the linear program, 
without increasing the objective function. We create a list of generalized configurations whose x* component 
is positive. From this list of generalized configurations, we find a list of windows that are the main window 
of at least one configuration induced by a generalized configuration in the list. This list of windows is a 
subset of W' defined above. We would like the solution to use only windows from W'. 

The new solution will have the property that any non-zero components of x* , x% corresponds to a gener- 
alized configuration C = (C, w), such that w € W. We still allow generalized configurations C = (C, w) 
where w is not the main window of C, as long as t/; G W. This is done in the following way. Given a 
window w' ^ W', we define X^' = Yl ^*c"- following is done in parallel for every generalized 

C"£C{w') 

configuration C' = (C, w'), where w' ^ W and such that x*-^ > 0, where the main window ofCisw>w' 
(but w' 7^ w). We let C = (C, w). The windows allocated for small items need to be modified first, thus 

an amount of -^f-Yi ^/ is transferred from Yi,w' to Yiw We modify the values x*-^ and x% as follows. We 
increase the value of x% by an additive factor of x*-, and let x*-, = 0. 

G G G 

To show that the new vector [x* , Y*) still gives a feasible solution of the same value of objective function, 
we consider the modifications. The sum of components of x* does not change at all in the above process, 
thus the value of the objective function is the same. Moreover, for every configuration C, the sum of 
components x*, that correspond to generalized configurations whose configuration of large items is C, does 
not change. Thus the constraints ([T]) still hold. We next consider the constraint ^ for i, for a given small 
item i ^ S. Since the sum of variables Y*-^y does not change, this constraint still holds. 

As for constraints ^ and (HJl, for a window w ^ W', the right hand side of each such constraint became 
zero. On the other hand, for windows in W', every increase in some variable x% for C = {C, w = {ws,Wn)), 
that is originated in a decrease of x*^, for C' = {C,w' = {w'^^w'^) is accompanied with an increase of 

— V X* ^iw = xT^i*t«' in ^iw^ for sv^ry i G 5, that is, an increase of XT'^i " ^iw' ™^ "ght 

C"6C{»') ^ 
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hand size of the constraint Q for w, and an increase of Wg ■ x*^, in the left hand side. Since we have 
Ws ■ ^w' ^ w'g ■ X^i > ^'i ' ^i*w' before the modification occurs (since constraint ([3]) for the window w' 

holds for the solution before the modification), we get that the increase of the left hand side is no smaller than 
the increase in the right hand side. There is an increase of ^ if-'Yi w' in the right hand size of the constraint 

dD for w, and an increase of Wn ■ x*-, in the left hand side. Since we have Wn ■ X^i > w'^ ■ X^i > ^ Y*u,/, 

we get that the increase of the left hand side is no smaller than the increase in the right hand side. 

Now, we can delete the constraints of ^ and dUl that correspond to windows in W \ W. In the resulting 
linear program we consider a basic solution that is not worse than the solution we obtained above. Such a 
basic solution can be found in polynomial time. We denote this basic solution by (x*, Y*). 

We apply several steps of rounding to obtain a feasible packing of the items into bins. We first round up 
X*. That is, denote by x the vector such that x^ = [x^] for all C € C Moreover, each small item i £ S 

such that {Y*^r)w&w is fractional, is packed using a dedicated bin. We modify the value of x^ for C that 
corresponds to an empty configuration C, together with the window (1, k), to reflect the additional bins that 
accommodate the small items that were previously packed fractionally. We modify the values {Y*^^)w£w 
so that every item i which is packed into a new bin has Yi^w = for all W, except for W = {1, k) for which 
Yi^w = 1- For all other variables Yi^w we define Yi^w = ^iw ^^^^ bound the increase in the cost due 
to this rounding. 

Lemma 1 J2 < E + 1^1 + 

dec cec 

Proof. Consider now the primal linear program, where constraints ^ and ^ exist only for windows in W', 
the variables exist only for generalized configurations C = (C, w) where w S W, and the variables 
Yi^w exists only for W G W'. The basic solution (x*, Y*) is a feasible solution for this linear program. In 
the primal linear program there are \H\ + 2\W'\ + l^l inequality constraints, and hence in a basic solution 
there are at most \H\ + 2\W'\ + \S\ basic variables. For every i £ S, there is at least one W such that 
Yi^iy, is a basic variable, and therefore the number of basic variables from the x components and additional 
basic variables from the Y components is at most 1-^1 + 2[W[. Hence the sum of the number of fractional 
components among the x^, variables, and the number of small items such that the vector {Y*y^r )w contains 
more than one non-zero component is at most \H\ + 2\W'\. This is an upper bound on the difference in the 
objective values of the two solutions and the claim follows. ■ 
Our scheme returns a solution that packs x^ bins with configuration C. Each large item of the rounded-up 

instance is replaced by the corresponding item of /. We clearly use at most ^ xc bins in this way. We next 

cgc 

pack each item of Li by its own bin (if Li is non-empty). We denote the resulting solution by SOLiarge- 
Lemma 2 The cost of SOLiarge <^t most E + eOPT. 

Proof. It suffices to show that \Li\ < sOPT. To see this last claim note that |Li[ < 2|L[e^ and each item 
in L has size at least s and therefore OPT > \L\e, and therefore \Li\ < 2e^OPT and the claim follows since 
e < 1/2. ■ 

Corollary 3 The number of bins used by SOLiarge is at most (1 + 2e)0PT + \H\ + 2|W'|. 
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We next consider the packing of the small items that are supposed to be packed (according to 1") in 
bins with a window of type W = {ws,Wn)- Assume that there are X{W) such bins (i.e., X(W) = 
J2 Xq). Denote by S{W) the set of small items that we decided to pack in bins with window W 

C:C={C,W) 

(for some of these items we will change this decision in the sequel). Then, by the feasibility of the linear 

program we conclude that 15(1^)1 < WnX{W) and s[< WgXiyV). We next show how to allocate 

ies{w) 

almost all items of S{W) to the X{W) bins with window W such that each such bin will contain at most k 
items (that is, at most Wn small items) and the total size of items in each such bin will be at most 1 + f^. 
To do so, we sort the items in 5(1^) according to non-increasing size (assume the sorted list of item indices 
is 6i > 62 > ■ ■ ■ > ^S{W)\)- Then, allocate the items to the bins in a round-robin manner, so that bin j 
receives items of indices 6j+p.x(VF) for all integers p > such that j + p ■ X{W) < 15(1^)1. We call the 

s' 

allocation of items for a given value of p a round of allocations. If Wg = -f^ then all items assigned to this 
type of window are of size 0, and the resulting allocation is valid in the sense that every bin contains items 
of total size at most 1, and at most k items per bin, and there is no need to adapt the packing of small items. 
We therefore assume Wg > s'^i^- We claim that the last bin of index X{W) received at most an x(w) 

\S{W)\ 

fraction of the total size of the items, whose sum is equal to ^ 6j. To prove this, we artificially add at 

i=l 

most X{W) — 1 items of size zero to the end of the list (these items are added just for the sake of the proof), 
and allocate them to the bins that previously did not receive an item in the last round of allocations, that is, 
bins r, . . . , X{W) such that bin r — 1 < X{W) received the last item. If bin X{W) received the last item 
then no items are added. Now the total size of small items remained the same, but every bin got exactly one 
item in each round. Since the last bin received the smallest item in each round, the claim follows. On the 
other hand, we can apply the following process, at every time i < X(W), remove the first (largest) small 
item from bin i. As a result, the round-robin assignment now starts from bin i + 1 and bin i becomes the bin 
that receives items last in every round, and thus by the previous proof, the total size of items assigned to it 

\S(W)\ 

is at most x(w) (^^^^^ ^^e total size of items does not increase in each step). 

We create an intermediate solution SOLinter by removing the largest small item from every bin and pack- 
ing these removed items in separate bins in groups of ^ removed items per bin (note that such bin is feasible 
as the total size of ^ small items is at most 1 and k > ^ and hence the cardinality constraint is satisfied as 
well). The total cost of this intermediate solution is therefore at most (l+e)-((l + 2c) OPT + + 2|>V'|) + 
1 (the last bin can contain less than i such removed items). We note that since we divide the items in S{W) 
equally (up to a difference of one item) to the X{W) bins, we conclude that after the removal of one item 
from each bin (or even before that), every such bin has at most k items (both large and small), and therefore 
all the bins satisfy the cardinality constraint. Moreover, the total size of small items assigned to such bin 
(after the removal of one item per bin) is at most Wg by the above argument regarding the total size of small 
items in a bin where the largest small item was removed. 

The intermediate solution is infeasible because our definition of Wg is larger than the available space for 
small items in such bin. We create the final solution SOL final as follows. Consider a bin such that the 
intermediate solution packs to it large items according to configuration C, and small items with total size at 
most Ws{C). For every bin, we do not change the packing of large items. As for the small items, we remove 
them from the bin and start packing the small items into this bin greedily in non-decreasing order of the item 
sizes, as long as the total size of items packed to the bin does not exceed 1. The first item that does not fit 
into the bin we pack in separate bins (each such separate bin will contain - such first items for different bins 
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of SOLinter)- Similarly to the above argument these are feasible bins and they add an additive factor of e 
times the cost of SOLinter to the total cost of the packing (plus 1). 

By the definition of windows, the actual space in a bin with window {wg, Wn), that is free for the use of 
small items, is at least of size j^^. After the removal of the first item that does not fit into the space for 
small items, the remaining small items allocated to this bin have a total size of at most Wg — = 
Since by definition, < 1, the small items that were assigned to a bin but cannot be packed (not including 
the first item that was packed in the previous step) are of total size at most s. Similar considerations can 
be applied to the cardinaUty of these items. Since the unpacked items are the largest ones, the remaining 
unpacked items in a bin of SOLinter have cardinaUty of at most swn < £k. Therefore, we can pack the 
unpacked items of every - bins of SOLinter using one additional bin. In this way we get our final solution 
SOL final- We note that the cost of SOL final is at most (1 + 2e) times the cost of SOLinter plus two. 
Therefore the cost of SOL final is at most (1 + 2e) ((1 + e) ■ ((1 + 2e)0PT + \H\ + 2\W\) + 1) + 2 < 
(1 + 10£)OPT + b{\H\ + \W'\ + 1) < (1 + 10£)OPT + 5(^ + + 1)^/^) + 2 where the last inequality 
holds by £ < i, \H\ < ^ and |W'| < \C\ < + 1)^/^. Therefore, we have established the following 
theorem. 

Theorem 4 If k > ^, the above scheme is anAFPTASfor BPCC. 

Since we covered both cases, we obtain the following. 
Theorem 5 The above scheme is an AFPTASfor BPCC. 
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A First case of Section |3]: A; < ^ 

In this case we apply linear grouping for all items, and do not classify items into types. That is, we partition the items 
into classes Li, L2, ii/e3 such that \ne^~\ — \Li\ > \L2\ > ■■■ > l^i/eal — [ne^\ (note that this condition 
uniquely identifies the cardinality of each class), and such that if there are two items i, j with sizes Si > Sj and i E Lq 
and j e Lp then q < p (so Li receives the subset of largest items, and for 2 < p < -i;, Lp receives the largest 
items from / \ (Li U • • • U The two conditions uniquely define the allocation of items into classes up to the 

allocation of equal sized items. 

Then, we round up the sizes of the items in L2, ■ ■ ■ , Li/^s. as follows: For all values of p, p = 2, 3, . . . , l/e^, and 
for each item i G Lp, we define s'^ — max^g^ Sj to be the rounded-up size of item i. The rounded-up instance /' 
consists of the set of items / \ Li, where for every i, the size of item i is (the parameter k remained unchanged). We 
next argue that 0PT(/') < OPT. Given an optimal solution to /, OPT, we transform it into a solution to /'. We define 
a bijection from /' to /, so that every item of /' is mapped to an item of / that is no smaller, and can take its place 
in the packing. Since /' does not contain Li, and since \Li\ < (in both / and /', since the size of sets is not 

influenced by the rounding), we map every item of Li (for all i > 2) in /' to some item of in /. By our rounding, 
every item of Li in /' is no larger than any item of in /. 

Given the rounded-up instance I', we let a configuration of a bin C be a set of at most k items of /' whose total 
(rounded-up) size is at most 1 . We denote the set of all configurations by C (this set is not computed explicitly, and 
typically has an exponential size). We denote the set of item sizes in /' by H. For each v E H,we let n{v, C) be the 
number of items with size v in C, and we let n{v) be the number of items in /', with size v (where n{v) = [ne^\ 
or n{v) = \ne^\ unless several classes are rounded to the same size, thus \H\ < p-). We solve (approximately) the 
following linear program, where for each configuration C, there is a variable xc indicating the number of bins packed 
using configuration C. 

min J2 

s.t. ^ n(v,C)xc > n{v) \/v E H 
xc > VC e C. 

We let X* be an approximate (within a factor of 1 + e) solution to this linear program, and further define yc = [a;^] , 
for every configuration C e C. It can be seen that the vector y is a feasible solution to the linear program (since 
yc > Xc for all C, it satisfies all the constraints). Our scheme returns a solution that packs yc bins with configuration 
C, in this solution, there are at least n{v) slots for every v E H. Note that some of these slots may remain empty, 
which happens in the case that the number of slots is strictly larger than n{v). To get a solution for / \ Li, each item 

of the rounded-up instance is replaced by the corresponding item of /. We clearly use at most ^ yc bins in this way. 

cec 

To solve the above linear program approximately, we invoke the column generation technique of Karmarkar and 
Karp [21J . We next elaborate on this technique. The above linear program has an exponential number of variables and 
a polynomial number of constraints (neglecting the non-negativity constraints). Instead of solving the linear program, 
we solve its dual program (that has a polynomial number of variables and an exponential number of constraints). The 
variables correspond to the item sizes in H, their intuitive meaning can be seen as weights of these items. 

max ^ n{v)z^ 

s.t. n{v,C)z^ < 1 yc EC 

Zy>0 Mv eH. 

To be able to apply the ellipsoid algorithm, in order to solve the above dual problem within a factor of 1 + e, it suffices 
to show that there exists a polynomial time algorithm (polynomial in n and i) such that for a given solution z* (which 
is a vector of length | < Jj), decides whether z* is a feasible dual solution (approximately). That is, it either 
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provides a configuration C G C such that ^ n{v, C)z* > 1, or outputs that an approximate infeasibihty evidence 

veH 

does not exist, that is, for all configurations C G C, ^*(^; 1 + £ holds. In such a case, is a feasible 

dual solution that can be used. Such a configuration C can be found using an FPTAS for the following KNAPSACK 
PROBLEM WITH A MAXIMUM CARDINALITY CONSTRAINT (KCC): Given a set of item types H, where each item 
type V G H has a given multiplicity n{v), a volume z* and a size v, the goal is to pack a multiset of at most k items 
(taking the multiplicity, in which items are taken, into account, and letting the solution contain at most n{v) items of 
type v) and a total size of at most 1, so that the total volume is maximized. If the FPTAS to KCC finds a solution 
with a total volume greater than 1, then this solution is a configuration whose constraint in the dual linear program is 
violated, and we can continue with the application of the ellipsoid algorithm. Otherwise, the FPTAS to KCC finds a 
solution with a total volume of at most 1, since the FPTAS is an 1 + e approximation, it means that no solution with a 
total volume larger than 1+e exists, and therefore, all the constraints of the dual linear program are satisfied by the 
solution To provide an FPTAS for KCC, note that one can replace an item with size v by n{v) copies of this item 
and then one can apply the FPTAS of Caprara et al. |5| for the knapsack problem with cardinality constraints. The 
FPTAS of |5 1 clearly has polynomial time in the size of its input, and -. Since the number of items that we give to this 
algorithm as input is at most n, we can use this FPTAS and still let our scheme have polynomial running time. 

Since the approximated separation oracle that we described above runs in polynomial time (polynomial in n and i) 
we conclude that the approximated solution of the (primal) linear program x* is obtained in polynomial time (again 
polynomial in n and i). Since x* is a solution of a linear program with an exponential number of variables, x* is 
given in a compact representation, which is a list of non-zero components of the solution, together with their values. 
The set of items in / \ Li is packed according to the integral solution y as described above. It remains to pack Li. To 
do so, we pack each item of Li in a separate (dedicated) bin. Note that there are = [ne^] < ne^ + 1 such bins, 
and since OPT > f > ne"^ we conclude that the number of additional bins (used to pack Li) is at most eOPT + 1, so 

APX < J2 Vc + \ < J2 Vc + eOPT + 1. Therefore, it suffices to bound the cost, implied by y, in terms of OPT. 

cec' cec 

Instead of using an optimal solution to the linear program (whose value is a lower bound on 0PT(/'), since 0PT(/') 
is a valid solution to the linear program), we use a 1 + e-approximated solution, and this degrades the value of the 

returned solution within a factor of 1 + e (i.e., J2 < (1 + e) • 0PT(/')). 

cec 

We next bound J2 {vc ~ ^c)- Note that in the primal Unear program there are at most constraints (not including 
cec ^ 
non-negativity constraints), and hence in a basic solution (a property that we can always assume that x* satisfies) there 

are at most positive components, and hence there are at most fractional components. Therefore, ^ {yc — x"^) < 
^ ^ CeC 

1 

^' 

Therefore, APX < J2 2/c + eoPT+l = J2 J2 ivc - x^) + eoPT + 1 < (l + e)-OPT(/') + 4r + eoPT+l < 

cec cec cec 

(1 + 2e)oPT + + 1. Hence, we conclude the following theorem. 

Theorem 6 Ifk<^, the above scheme is an AFPTAS for BPCC. 

B An AFPTAS for BPR 

In this section we use the similarity between the APTAS of Caprara et al. f?] for BPCC and the APTAS of Epstein 
lfT4l for BPR to develop our methods further. We obtain an AFPTAS for BPR using adaptations to the methods of the 
previous section. 

Without loss of generality we assume that < 1 for all i. This is so as if there is an item with higher rejection 
penalty, then it is better to pack this item in a separate additional bin instead of rejecting it, and this situation is true 
for an item with a unit rejection penalty as well. Therefore, by changing the rejection penalty of such an item to 1, we 
do not change the optimal solution or a (reasonable) approximate solution. 

Let < e < i be such that ^ is an integer An item j is large if both Sj > e and rj > e. All other items are small. 
We denote by L the set of large items, and by S the set of small items. 
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We perform rounding of the rejection penalties and the sizes of the large items (only). For i = 0, 1, . . . , A = ^ — i, 
and every large item j £ L, such that rj G [e + ie^, e + {i + l)e^), we round down the rejection penalty rj to e + ie^. 
For a large item j, denote the rounded rejection penalty of j by r^ , and for a small item j let t'^ — rj. Define /' to be 
the adapted input, ALG(/') be the cost of an arbitrary algorithm ALG on the input /', and let ALG'(/') be the cost of 
the same algorithm on the original items. Then, Epstein ifMj showed the following: 

Lemma 7 (Lemma 1 in |14|) alg'(/') < (1 + e)ALG(/') and opt(/') < opt(/). 

For i = 0, 1, . . . , A, let ^ {ji, . . . , } be the set of large items with rounded rejection penalty e + ie^, such 
that > > • • ■ > Sj^ . For each set U such that |L*| > we perform linear grouping separately. That 
is, for values of i such that \U\ > p-, we let m = and we partition U into m classes L\, . . . , L]^ such that 
[n^e^] = l^ll > 1^2! ^ ■ ■ ■ ^ l-^ml — \nie^\, and receives the largest items from U \ \_L\\J ■ ■ ■ \J ip_i] . For 
every i = 0, 1, . . . , A and j = 2, 3, . . . , we round up the size of the elements of to the largest size of any element 
of Uy For item j of a set Lp (p > 2), we denote by s'^ the rounded-up size of the item, which is defined to be equal 
to the maximum size of any item in i^. For items in L\ (for all i) we do not round the sizes, and we denote = Sj 
for all j G Li. For values of i such that \U\ < each large item of U has its own set such that L\ is an empty 
set, and for a large item j £ U we let = Sj. We note that in both cases (i.e., for large and small cardinalities of i*) 
we have \L\\ < 2e^\U\. For j e 5 we also denote s'j — sj. We denote by Li — U^qL^ and L' ~ L \ Li. By the 
above, we have \Li\ < 2e^\L\. We consider the instance /" consisting of the items in L' L) S with the (rounded-up) 
sizes function s' and the rounded rejection penalty function r'. The items in Li are packed each in a separate bin. We 
have 0PT(/") < OPT(J'), similarly to the previous sections. We next describe the packing of the items in /". 

Given the instance /", we let a configuration of a bin C be a (possibly empty) set of items of L' whose total 
(rounded-up) size is at most 1. We denote the set of all configurations by C. Let H ~ {(ui, pi), ... (0-4, pf)} be the 
set of different types of large items where aj denotes the (rounded-up) size of an item with type {dj, pj), and pj is 
its (rounded) rejection penalty. We have \H\ < -ij ■ A < For each v £ H we denote hy n{v, C) the number of 
items with type v in C, and we denote by n{v) the number of items in /" with type v. For a large item j, we denote 
by type{j) the type of j. 

We denote the minimum size of an item by s,„i„ = min^gs (recall that in BPR, it is assumed that sizes of 
items are strictly larger than 0), and as in the previous section, we let s^j„ = max{ i^i^^y \t S (^i^^y < Smin}- 
The value logj^^^ is polynomial in the size of the input. We define the following set W = { (i4^g)t |0 < i < 

logi^j -p^ h 1}. A window is defined as a member of W. W is also called the set of all possible windows. Then, 

W| < •(log]^_|_g ^7^!^ h 2). Since windows are scalars, they can be compared with respect to their size. 

Note that each bin packed with large items according to a configuration C typically leaves space for small items. For 
a configuration C we denote the main window ofC to be w{C), which can be seen as an approximation of the available 
size for small items in a bin with configuration C. We define it as follows. Assume that the total (rounded-up) size of 

the items in C is s'(C). Then, w{C) = (^i^^y where t is the maximum integer such that < t < log]^_|^g -p^ h 1 and 

that s'(C) + (^i^^y > 1- The main window of a configuration is a window (i.e., belongs to W), but W may include 
windows that are not the main window of any configuration. We note that | W| is polynomial in the input size and in 
i, whereas \C\ may be exponential in i, specifically, \C\ < + lY^"^, since in configuration there are up to i large 
items of \H\ < types. We denote the set of windows that are actual main windows of at least one configuration by 
W' ■ Similarly to the previous section, we define a linear program that allows the usage of any window in W and later 
modify the linear program and the solution to this linear program (that we obtain) to use only windows of W' . 

We define a generalized configuration (7 as a pair C — {C,w = i^^^^y for some configuration C, and some 

w G W. The generahzed configuration C is valid if w < w{C). The set of all valid generalized configurations is 
denoted by C. For every W G W denote by C{W) the set of generalized configurations such that W is their window, 
i.e., C{W) ^ {C = {C,w) eC -.w = W}. 

We next consider the following linear program. In this linear program we have a variable denoting the number 
of bins with the generalized configuration C, variables Yi^w indicating if the small item i is packed in a window of 
type W, and variables Zi indicating that item i is rejected (for both small and large items). 
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min E fi^i 

s.t. J2 n{v, C)x^ + Zj> n{v) Vv eH (7) 

C={C,w)£C j-typeij)=v 

E Y^.w + z^>l yieS (8) 

w- E ^c>T.<■y^,w -iw ew (9) 

C^C(W) i<^S 

> VC e C 

r,,vF>0 VT4^e>V,Vie/" 
Zi>0 yie I". 

Constraints (|7]) and ([8]l ensure that each item (large or small) of /" is packed or rejected by the solution. Constraints 
(|9]l ensure that the total size of the small items that we decide to pack in a window of type W is not larger than the 
total available space allocated to the windows of small items, that is, the number of bins that are packed according to a 
generalized configuration that has this window is large enough. We note that 0PT(/") implies a feasible solution to the 
above linear program that has the cost 0PT(/"), since the packing of the small items (including the specification of the 
subset of rejected items) clearly satisfies the constraints (|9]l, and the packing of large items (including the specification 
of the subset of rejected items) satisfies the constraints O. Moreover, it implies a solution to the linear program in 
which all variables x^j, that correspond to generalized configurations C — {C, w), for which w is not the main window 
of C, are equal to zero, and all variables Yi,^ where w ^ W are equal to zero as well. 

Once again (similarly to the AFPTAS for BPCC) we invoke the column generation technique of Karmarkar and Karp 
Il2n as follows. The above linear program has exponential number of variables and polynomial number of constraints 
(neglecting the non-negativity constraints). Instead of solving the linear program we solve its dual program (that has 
a polynomial number of variables and an exponential number of constraints). The variables a„ correspond to the item 
types in H, their intuitive meaning can be seen as weights of these items. The variables (3i correspond to the small 
items, and their intuitive meaning can be seen as weights of these items. For each W E W we have a dual variable 
jw- Using these dual variables, the dual linear program is as follows. 



max J2 n{v)av + J2 f^i 

s.t. Y riiv,C)a^ +w"f^o <l yC={C,w)eC (10) 

P^-s'^"fw<0 VieS.yW eW (11) 

A < < yieS (12) 

<r[ Vw e H, yi e L' : type{i) = v (13) 

a„ > \/v (E H 

(3i>0 Vies 

jw>o yw eW. 

First note that there is a polynomial number of constraints of type ( fTTT l. ( fT2b and ( fT3]) . and therefore we clearly have 
a polynomial time separation oracle for these constraints. If we would like to solve the above dual linear program 
(exactly) then using the ellipsoid method we need to establish the existence of a polynomial time separation oracle 
for the constraints ( flOl i. However, we are willing to settle on an approximated solution to this dual program. To be 
able to apply the ellipsoid algorithm, in order to solve the above dual problem within a factor of 1 + e, it suffices to 
show that there exists a polynomial time algorithm (polynomial in n, i and log -jr—) such that for a given solution 
a* — (a*, 7*) decides whether a* is a feasible dual solution (approximately). 
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That is, it either provides a generalized configuration C = {C,w) G C for which ^ n{v,C)al + wj^ > 1, 

or outputs that an approximate infeasibility evidence does not exist, that is, for all generalized configurations C = 
(C, w) e C, J2 '^(^j + wj*^ < 1 + e holds. In such a case, y— is a feasible dual solution that can be used. 

Such a configuration C can be found by the following procedure: For each e W we look for a configuration 
C e C such that (C, W) is a valid generalized configuration, and ^ n{v, C)a* is maximized. If a configuration C 

that is indeed found, the generalized configuration, whose constraint is checked, is (C, W). 

To find C, we invoke an FPTAS for the standard knapsack problem with the following input: The set of items is H 
where for each v G H there is a volume a* and a size v, the goal is to pack a multiset of the items (an item can appear 
at most a given number of times), so that the total volume is maximized, under the condition that the total (rounded-up) 
size of the multiset should be smaller than 1 — unless W < sj„j„, where the total size should be at most 1 (in 
this case, the window leaves space only for items of size zero). Since the number of applications of the FPTAS for the 
knapsack problem is polynomial (i.e., |yV|), this algorithm runs in polynomial time. 

If it finds a solution, that is, a configuration C, with total volume greater than 1 — Wj^, we argue that (C, W) 
is indeed a valid generalized configuration, and this implies that there exists a generalized configuration, whose dual 
constraint ( fTol i is violated. 

By the definition of windows, the property W < s',jj„ is equivalent to = "f+F' which is the smallest size of 
window (which forms a valid generalized configuration with any configuration). If W > s^j„, recall that the main 
window of C, w{C) is chosen so that s'(C) + w{C) > 1, and that C is chosen by the algorithm for the knapsack 
problem, so that s'(C) < 1 - We get 1 - w{C) < s'{C) < 1 - and therefore W < {I + e)w{C), 

i.e., W < w{C) (since the sizes of windows are integer powers of 1 + e), so we conclude that (C, W) is a valid 
generalized configuration. Thus in this case we found that this solution is a configuration whose constraint in the dual 
linear program is not satisfied, and we can continue with the application of the ellipsoid algorithm. 

Otherwise, for any window W, any configuration C of total rounded-up size less than 1 — (or at most 1, if 
W < s^i„), has a volume of at most (1 + e){l — Wj^) < (1 + e) — W^^. We prove that in this case, all the 
constraints of the dual linear program are satisfied by the solution Consider a valid generalized configuration 

C = (C, w). We have w < w{C), where w{C) is the main window of C. If w{C) < s^j„, then w — w(C). Since 
s'{C) < 1 for any configuration, C is a possible configuration to be used with the window w in the application of 
the FPTAS for knapsack. Assume next that w < 1, then when the FPTAS for knapsack is applied on W, C is a 
configuration that is taken into account for W since s '(C) < 1 - < 1 - ifj, where the first inequality holds by 
definition of w{C). If w — 1 then 1 > w{C) > w ~ 1, so w{C) = 1. A configuration Ci that contains at least one 
large item satisfies s'(Ci) > e, so s'(Ci) + > > 1- Therefore if the main window of a configuration is 

of size 1, this configuration is empty. We therefore have that C is an empty configuration, thus s'(C) ~ 0. This empty 
configuration is considered with any window. 

We denote by {X*, Y*, Z*) the solution to the primal linear program that we obtained. Since its cost is a (1 + e) 
approximation for the optimal solution to the linear program, we conclude that J2 ^% + J2 ^[Z* < {\ + 

cec ieL'us 

£)OPT(/"). 

We modify the solution to the primal linear program, into a different feasible solution of the linear program, without 
increasing the objective function. We create a list of generaUzed configurations whose X* component is positive. From 
this list of generalized configurations, we find a list of windows that are the main window of at least one configuration 
induced by a generalized configuration in the list. This list of windows is a subset of W' defined above. We would 
like the solution to use only windows from W'. 

We modify the X* and Y* components, while the Z* components are not modified. The new solution will have 
the property that any non-zero components of X*, X^ corresponds to a generalized configuration C — (C, w), such 

that w e W. We still allow generalized configurations C ~ (C, w) where w is not the main window of C, as long 
as u; G W". This is done in the following way. Given a window w' ^ W', we define B^i = ^ -^cJ"' 

C"ec(w') 

following is done in parallel for every generahzed configuration C — (C, w'), where w' ^ W' and such that X^, > 0, 
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where the main window of C is w > w' (but w' ^ w). We let C = (C, w). The windows allocated for small items 

need to be modified first, thus an amount of -g^li^u,' is transferred from 1^^^' to l^.u,. We modify the values X^^ and 
as follows. We increase the value of X*^ by an additive factor of X*^, and let X*^, — 0. 

To show that the new vector {X*, Y*, Z*) still gives a feasible solution of the same value of objective function, we 
consider the modifications. The sum of components of X* does not change at all in the above process, thus the value of 
the objective function is the same. Moreover, for every configuration C, the sum of components X*, that correspond 
to generalized configurations whose configuration of large items is C, does not change. Thus the constraints ^ still 
hold. We next consider the constraint (O for i, for a given small item i E S. Since the sum of variables Y*^ does not 
change, this constraint still holds. 

As for constraints (|9]l, for a window w ^ W", the right hand side of each such constraint became zero. On the other 
hand, for windows in W', every increase in some variable X*^ for C — (C, w), that is originated in a decrease of X*^, 

for C = {C,w') is accompanied with an increase of — x* ^iw' ~ s^^/tu' ™ ^iw^ ^'^^ every i E S, thus 

c"ec{w') 

is, an increase of ^ "g^'^' ' ^*tu' ™ '^^e right hand size of the constraint (|9]l for w, and an increase of w ■ x*^, in the 
ies ' 

left hand side. Since we have w ■ B^,' > w' ■ B^i > J2 ' ^i'w' before the modification occurs (since constraint 

^ holds for the solution before modification for the window w'), we get that the increase of the left hand side is no 
smaller than the increase in the right hand side. 

Now, we can delete the constraints of (|9]l that correspond to windows in W \ W". In the resulting linear program we 
consider a basic solution that is not worse than the solution we obtained above. Such a basic solution can be found in 
polynomial time. We denote this basic solution by (X* , Y* , Z* ). 

We apply several steps of rounding to obtain a feasible packing of the items into bins. We first round up X*. That 
is, denote by X the vector such that X^^ = [X*^] for all C £ C. Moreover, each small item i G S such that 

(Y* ^y)w£W is fractional, is packed using a dedicated bin. We modify the value of X(j for C that corresponds to an 
empty configuration C, together with the window 1, to reflect the additional bins that accommodate the small items 
that were previously packed fractionally. We modify the values (y* iY)wew so that every item i which is packed into 
a new bin has Yi^w = for all W except for W = 1, for which Yi,w — 1- For all other variables Yi,w we define 
Yi^w = Y* w- For every i e /' we let Z,; = Z*. 
We next bound the increase in the cost due to this rounding. 

Lemma 8 J2 < J2 + \H\ + 

cec cec 

Proof. Consider now the primal linear program, where constraints (|9]l exist only for windows in W', the variables X(=, 
exist only for generalized configurations C = (C, w) where w E W, and the variables Yi^w exists only for W € W'. 
The basic solution (X*, Y*, Z*) is a feasible solution for this linear program. In the primal linear program there are 
\H\ + 1 W'l + \ S\ inequality constraints, and hence in a basic solution there are at most \H\ + 1 W| + \ S\ basic variables. 
For every i E S, there is at least one variable associated with i that is a basic variable. This variable is either Zi or 
Yi^W' for some W, and therefore the number of basic variables from the x components and additional basic variables 
from the Y and Z components is at most + |VV"|. Hence the sum of the number of fractional components among 
the a; (5 variables, and the number of small items such that the vector (Y*^)vi/ is non-integral is at most + | W"|. 
This is an upper bound on the difference in the objective values of the two solutions and the claim follows. ■ 
Our scheme returns a solution that packs X^j bins with configuration C. Each large item of the rounded-up instance 

is replaced by the corresponding item of /. We clearly use at most ^ X^ bins in this way. We next pack each item 

cec 

of Li by its own bin (if Li is non-empty). We denote the resulting solution by SOLiarge- 

Lemma 9 The cost of SOLiarge is at most J2 -^0+ r'^Zi + eOPT. 

dec *e-f' 

Proof. It suffices to show that \Li \ < eOPT. To see this last claim note that |Li | < 2|L|£'^ and each item in L has both 
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a size of at least e and a rejection cost of at least e and therefore OPT > \L\e, and therefore \Li \ < 2£^opt and the 
claim follows since e < 1/2. ■ 

Corollary 10 The cost of SOLiarge is utmost (1 + 2e)0PT + + |W'|. 

We next consider the packing of the small items that are supposed to be packed (according to Y) in bins with window 
W. Assume that there are X{W) such bins (i.e., X{W) = ^ ^c^- Denote by S{W) the set of small items 

C:C={C,W) 

that we decided to pack in bins with window W (for some of these items we will change this decision in the sequel). 
Then, by the feasibility of the hnear program we conclude that ^ s'i<W ■ X{W). We allocate almost all S{W) 

to the X{W) bins with window W such that the total size of the items in each such bin is at most 1 + exactly as in 

the previous section. As in the previous section, we create an intermediate solution SOLinu-T by removing the largest 
small item from each such bin. Each removed item is small and therefore either its rejection penalty is at most e or its 
size is at most e. We pack the removed small items with size at most e in new bins, packing i such items in a bin, except 
perhaps the last such bin, and the other removed items are rejected (incurring a rejection penalty of at most e for each 
such item). The total cost of this intermediate solution is therefore at most (1 + e) • ((1 + 2£)opt + \H\ + | W|) + 1 
(the last bin can contain less than i such removed items). As in the previous section, after the largest small items is 
removed from each bin, the total size of small items assigned to such bin is at most W . 

The intermediate solution is infeasible because our definition of W is larger than the available space for small items 
in such bin. We create the final solution SOL final using the same process as in the previous section. That is, given a 
bin such that the intermediate solution packs to it large items according to configuration C, and small items with total 
size at most w{C), we remove the small items and pack them back until the first item that causes an excess. The first 
items whose rejection penalties are smaller than e are rejected. The other ones are packed in separate bins (each such 
separate bin will contain i such first items for different bins of SOLinter)- Similarly to the above argument these 
are feasible bins and they add an additive factor of e times the cost of SOLinter to the total cost of the packing (plus 
1). The remaining unpacked items in a bin of SOLinter have total size of at most |^ < e. Therefore, we can pack 
the unpacked items of ^ bins of SOLinter using one additional bin. In this way we get our final solution SOL final- 
We note that the cost of SOL final is at most (1 + 2e) times the cost of SOLinter plus one. Therefore the cost of 
SOL f,nai is at most (1 + 2e) ((1 + e) • ((1 + 2e)0PT + \H\ + + 1) + 1 < (1 + 10e)OPT + 4(|iJ| + \W\ + 1) < 
(l + 10e)oPT+4j^+4(^ + l)i/^ + l where the lastinequahty holds by £ < \,\H\ < ^and|W| < \C\ < + 
Therefore, we have established the following theorem. 

Theorem 11 The above scheme is an AFPTASfor BPR. 
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